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Abstract. V'yugin HIH] has shown that there are a computable shift-invariant 
measure on 2" and a simple function / such that there is no computable bound 
on the rate of convergence of the ergodic averages Anf- Here it is shown that 
in fact one can construct an example with the property that there is no com- 
putable bound on the complexity of the limit; that is, there is no computable 
bound on how complex a simple function needs to be to approximate the limit 
to within a given e. 



Let 2'*' denote Cantor space, the space of functions from N to the discrete space 
{0, 1} under the product topology. Viewing elements of this space as infinite se- 
quences, for any finite sequence a of O's and I's let [cr] denote the set of elements 
of 2^ that extend a. The collection B of Borel sets in the standard topology are 
generated by the set of such [cr]. For each k, let Bk denote the finite cr-algebra 
generated by the partition {[cr] | length(cr) = k}. If a function / from 2^ to Q is 
measurable with respect to I will call it a simple function with complexity at 
most k. 

Let /i be any probability measure on (2*^,^), and let / be any element of L^{^)- 
Say that a function k from to N is a hound on the complexity of f if, for every 
£ > 0, there is a simple function g of complexity at most k{£) such that ||/ — g|| < e. 
If (/„) is any convergent sequence of elements of L^{p) with limit /, say that r{e) 
is a bound on the rate of convergence of (/„) if for every n > r(e), ||/„ — /|| < e. 
(One can also consider rates of convergence in any of the norms for 1 < p < oo, 
or in measure. Since all the sequences considered below are uniformly bounded, 
this does not affect the results below.) 

Now suppose that /i is a computable measure on 2^*^ in the sense of computable 
measure theory [1] |4]. Then if / is any computable element of there is a 

computable sequence (/„) of simple functions that approaches / with a computable 
rate of convergence r(e); this is essentially what it means to be a computable 
element of (/i) . In particular, setting k{e) equal to the complexity of /r(e) provides 
a computable bound on the complexity of /. But the converse need not hold: if 
r is any noncomputable real number and / is the constant function with value r, 
then / is not computable even though there is a trivial bound on its complexity. 

It is not hard to compute a sequence of simple functions (/„) that converges to 
a function / even in the L°° norm with the property that there is no computable 
bound on the complexity of the limit, with respect to the standard coin-flipping 
measure on 2^. Notice that this is stronger than saying that there is no computable 
bound on the rate of convergence of (/„) to /; it says that there is no way of 
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computing bounds on the complexity of any sequence of good approximations to 
/• 

To describe such a sequence, for each fc, let hk be the Sfe-measurable Rademacher 
function defined by 

{(T I lcngth(cr) — fc} 

where ak-i denotes the last bit of a and l^g.] denotes the characteristic function of 
the cylinder set [a]. Intuitively, hk is a "noisy" function of complexity k. Finally, 
let /„ = '^i<^n^~^^^''hi, where is an injective enumeration of any computably 
enumerable set, like the halting problem, that is not computable. Given any m, 
if n is large enough so that ip{j) > m whenever j > n, then for every i > n and 
every x we have \ fi{x) - fn{x)\ < J2j>m < 1/(3 ' 4"). Thus the sequence (/„) 
converges in the L°° norm. At the same time, it is not hard to verify that if / is 
the limit of this sequence and g is a simple function of complexity at at most n 
such that n{{x \ \g{x) — f{x)\ > 4~*^™+^'}) < 1/2, then m is in the range of ip if 
and only if ip{j) — n for some j < n. Thus one can compute the range of ip from 
any bound on the complexity of /. 

The sequence (/„) just constructed is contrived, and one can ask whether similar 
sequences arise "in nature." Letting A„/ denote the ergodic average i X)i<n /°^"' 
the mean ergodic theorem implies that for every measure ^ on 2'*' and / in L^(/i), the 
sequence (Anf) converges in the norm. However, V'yugin [2j[3] has shown that 
there is a computable shift-invariant measure /i on Cantor space such that there is no 
computable bound on the rate of convergence of {An 1 [i] ) • In V'yugin's construction, 
the limit doesn't have the property described in the last paragraph; in fact, it is very 
easy to bound the complexity of the limit in question, which places a noncomputable 
mass on the string of O's and the string of I's, and is otherwise homogeneous. The 
next theorem shows, however, that there are computable measures fj, such that the 
limit does have this stronger property. 

Theorem. There is a computable shift-invariant measure fi on 2^ such that if f = 
lim„ A„l[i], the halting problem can be computed from any bound on the complexity 
off. 

Proof. If (7 is any finite binary sequence, let a* denote the element crcrcr ... of Cantor 
space. For each e, define a measure /le as follows: if Turing machine e halts in s 
steps, let fie put mass uniformly on these 8s elements: 

• all 4s shifts of (I'O^^)* 

• all 4s shifts of (13^0^)* 

Otherwise, let fie divide mass uniformly between 0* and 1*. Each measure /ie is 
shift invariant, by construction. I will show, first, that fie is computable uniformly 
in e, which is to say, there is a single algorithm that, given e, a, and e > 0, computes 
/ie([cr]) to with e. I will then show that information as to the complexity needed to 
approximate / in (2", B, fie) allows one to determine whether or not Turing machine 
e halts. The desired conclusion is then obtained by defining fi = 2~('^+^)/ie. 

If Turing machine e does not halt, /ie([(T]) = 1/2 if cr is a string of O's or a string 
of I's, and MeClf]) = otherwise. Suppose, on the other hand, that Turing machine 
e halts in s steps, and suppose k < s. Then there are 2(fc — 1) additional strings a 
with length k such that /Xe([cr]) > 0, each consisting of a string of I's followed by a 
string of O's or vice versa. For each of these a, fie{[o']) = l/4s, and if (t is a string 
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of O's or a string of I's of length k, /Xe([<T]) = 1/2 — (fc — l)/4s. Thus when s is 
large c;ornpared to k, the non-halting case provides a good approximation to /Xe([tT]) 
when length((j) < k, even though e eventually halts. Thus, to compute Ate([f7]) to 
within e, it suffices to simulate the eth Turing machine 0{k/e) steps. If it halts 
before then, that determines yUg exactly; otherwise, the non-halting approximation 
is close enough. 

Now consider / = lim„^„l[i] in {2'^,B,fie)- Note that (^„l[i])(a;) counts the 
density of I's among the first n bits of oj. If Turing machine e does not halt, 
/(w) = 1 if a; is the sequence of I's, and /(w) = if w is the sequence of O's. Up 
to a.e. equivalence, these are all that matters, since the mass concentrates on these 
two elements of Cantor space. If Turing machine e halts in s steps, then f{co) = 1/4 
on the shifts of (PO^^)*, and /(w) = 3/4 on the shifts of (l^^O*)*. 

Suppose g is ;Bfe-measurable. If Turing machine e halts in s steps and k is much 
less than s, then roughly 3/4 of the shifts of (1*0^*)* lie in [O'^] and roughly 1/4 lie 
in [1*^]; and roughly 3/4 of the shifts of (1^*0*)* lie in [1*^] and roughly 1/4 he in 
O*'. But f{uj) only takes on the values 1/4 and 3/4, and g is constant on [0*^] and 
[l*^]. So if k is much less than s, ^e({w | |/(w) - g{u})\ > 1/8}) > 1/4. Turning this 
around, given the information that lJ,e{{oJ \ |/(w) — g{u))\ > 1/8}) < 1/4 for some g 
of complexity at most k enables one to determine whether or not Turing machine 
e halts; namely, one simulates the Turing machine for 0{k) steps, and if it hasn't 
halted by then, it never will. 

Set fj, = 2~('^+-^)^e. Since, for any g, 

He{{u I \fico) - 5MI > 1/8}) < 1 l/(c.) - 5(c^)| > 1/(8 • 2^+^)}), 

knowing a fee for each e with the property that /u({a; | \f{uj) — g{u))\ > 1/(8-2^+^)} < 
1/4 for some g of complexity at most fee enables one to solve the halting problem. 
But such a ke can be obtained from a bound on the complexity of /. Thus jj, 
satisfies the statement of the theorem. □ 

The proof above relativizes, so for any set X there is a measure n on 2^*^, com- 
putable from X , such that no bound on the rate of complexity of / can be computed 
from X. As the following corollary shows, this implies that lim„ A„l[i] can have 
arbitrarily high complexity. 

Corollary. For any v : Q"*" — >■ N there is a measure ^ on 2^ such that if J = 
lim„ A„l[i] and k{e) is a hound on the complexity of f, then limsupg_^o ^(^)/'^(^) 

Proof. Let /x be such that no bound on the complexity of / can be computed from 
V. If the conclusion failed for some k, then there would be a rational e' > and 
such that for every e < e' , k{e) < N ■ v(e). But then k'{s) = N ■ f(min(e, e')) 
would be a bound on the complexity of / that is computable from v, contrary to 
our choice of /x. □ 
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